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I. REAL PARTY IN INTEREST 

The real party in interest is Hewlett-Packard Development Company, L.P. 
(HPDC), a Texas Limited Partnership, having its principal place of business in 
Houston, Texas. HPDC is a wholly owned affiliate of Hewlett-Packard Company 
(HPC). The Assignment from the inventors to HPDC was recorded on February 
6, 2004, at Reel/Frame 014968/0891 . 
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II. RELATED APPEALS AND INTERFERENCES 

Appellants are unaware of any related appeals or interferences. 
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III. STATUS OF THE CLAIMS 

Originally filed claims: 1-24. 

Claim cancellations: 7, 8, 14, 19, 20, 23 and 24. 

Added claims: None. 

Presently pending claims: 1-6, 9-13, 15-18, 21 and 22. 

Presently appealed claims: 1-6, 9-13, 15-18, 21 and 22. 
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IV. STATUS OF THE AMENDMENTS 

No claims were amended after the final Office Action dated April 1 7, 2009. 
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V. SUMMARY OF THE CLAIMED SUBJECT MATTER 

This section provides a concise explanation of the subject matter defined 
in each of the independent claims, referring to the specification by page and line 
number or to the drawings by reference characters as required by 37C.F.R. 
§ 41 .37(c)(1)(v). Each element of the claims is identified with a corresponding 
reference to the specification or drawings where applicable. The specification 
references are made to the application as filed by Appellants. Note that the 
citation to passages in the specification or drawings for each claim element does 
not imply that the limitations from the specification and drawings should be read 
into the corresponding claim element. Also note that these specific references 
are not exclusive; there may be additional support for the subject matter 
elsewhere in the specification and drawings. 

Automatic speech recognition (ASR) systems convert spoken words into 
computer-readable representations. An ASR engine may be the subject of a 
license. The license may specify the maximum number of simultaneous 
connections that may be established with the ASR engine. Unfortunately, the 
particular maximum number of connections may not always be enough. 
Appellants' contribution addresses this problem. 1 

The invention of claim 1 is a system 2 that comprises a first speech 
recognition engine, 3 a second speech recognition engine, 4 and evaluation logic 5 
coupled to the first and second speech recognition engines. The evaluation logic 
evaluates the first and second speech recognition engines based on evaluation 
signals from a user 6 and, based in part on the evaluation, selects one of the 
speech recognition engines to process additional speech signals from the user. 7 

1 See Appellants' disclosure page 1 , line 1 of para. [0001] through line 7 of para. [0002]. 

2 Fig. 2, 114. Appellants' disclosure p. 3, line 1 of para. [0013]. 

3 Fig. 2, 212. Appellants' disclosure p. 3, line 4 of para. [0013]. 

4 Fig. 2, 214. Appellants' disclosure p. 3, line 5 of para. [0013]. 

5 Fig. 2, 210. Appellants' disclosure p. 3, line 4 of para. [0013]. 

6 Appellants' disclosure p. 5, lines 7-8 of para. [0019]. 

7 Appellants' disclosure p. 5, lines 10-12 of para. [0019]. 
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The first speech recognition engine permits a plurality of ports to be used on 
behalf of a plurality of users. 8 The system further comprises a port monitor 9 
coupled to the first speech recognition engine and to the evaluation logic. The 
port monitor determines a number of currently available ports. 10 If the number of 
currently available ports exceeds a threshold, the port monitor causes the first 
speech recognition engine to be selected and used. 11 

The invention of claim 9 is a system 12 that comprises first means for 
recognizing speech, 13 second means for recognizing speech, 14 and means for 
evaluating 15 a parameter associated with the first and second means for 
recognizing speech based on evaluation voice input from a user 16 during a 
session and, based on the evaluation, for selecting one of the first and second 
means for recognizing speech. 17 The system also comprises means for 
monitoring 18 a number of available ports 19 associated with the first means for 
recognizing speech and for selecting the first means for recognizing speech if the 
number of available ports exceeds a threshold. 20 

The invention of claim 15 is directed to a method that comprises evaluating 
an evaluation set of utterances from a user during a session. 21 Based on 
evaluating the evaluation set of utterances, the method further comprises 

8 Appellants' disclosure p. 4, lines 1-3 of para. [0017]. 

9 Fig. 2, 208. Page 3, line 4 of para. [0013]. 

10 Appellants' disclosure p. 7, lines 3-5 of para. [0025]. 

11 Appellants' disclosure p. 7, lines 8-10 of para. [0025]. 

12 Fig. 2, speech recognition module 114. Appellants' disclosure p. 3, line 1 of para. [0013]. 

13 Fig. 2, primary ASR engine 212. Appellants' disclosure p. 3, line 4 of para. [0013]. 

14 Fig. 2, secondary ASR engine 214. Appellants' disclosure p. 3, line 5 of para. [0013]. 

15 Fig. 2, evaluator 210. Appellants' disclosure p. 3, line 4 of para. [0013]. 

16 Appellants' disclosure p. 5, lines 7-8 of para. [0019]. 

17 Appellants' disclosure p. 5, lines 10-12 of para. [0019]. 

18 Fig. 2, port monitor 208. Page 3, line 4 of para. [0013]. 

19 Appellants' disclosure p. 7, lines 3-5 of para. [0025]. 

20 Appellants' disclosure p. 7, lines 8-10 of para. [0025]. 

21 Appellants' disclosure p. 5, lines 7-8 of para. [0019]. 
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selecting between a first speech recognition engine and a second speech 
recognition engine 23 for the remainder of the session. 24 The method also 
comprises automatically selecting the first speech recognition engine if a number 
of available ports associated with the first speech recognition 25 engine exceeds a 
predetermined value. 26 

Claim 21 is directed to a storage medium containing code 27 that can be 
loaded into a computer 28 and executed by a processor in the computer. The 
code causes the computer to evaluate an evaluation set of utterances from a 
user, 29 and based on the evaluation of the evaluation set of utterances, select 
between a first speech recognition engine and a second speech recognition 
engine. 30 The code also causes the computer to determine a number of available 
ports associated with the first speech recognition engine 31 and to automatically 
select the first speech recognition engine if the number of available ports is above 
a threshold. 32 



zz Fig. 2, 212. Appellants' disclosure p. 3, line 4 of para. [0013]. 

23 Fig. 2, 214. Appellants' disclosure p. 3, line 5 of para. [0013]. 

24 Appellants' disclosure p. 5, lines 10-12 of para. [0019]. 

25 Appellants' disclosure p. 7, lines 3-5 of para. [0025]. 

26 Appellants' disclosure p. 7, lines 8-10 of para. [0025]. 

27 Fig. 1, 110. Appellants' disclosure pp. 3-5, lines 5-9 of para. [0010]. 

28 Fig. 1, 102. Appellants' disclosure p. 3, line 3 of para. [0010]. 

29 Appellants' disclosure p. 5, lines 7-8 of para. [0019]. 

30 Appellants' disclosure p. 5, lines 10-12 of para. [0019]. 

31 Appellants' disclosure p. 7, lines 3-5 of para. [0025]. 

32 Appellants' disclosure p. 7 lines 8-10 of para. [0025]. 
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VI. GROUNDS OF REJECTION TO BE REVIEWED ON APPEAL 

Whether claims 1-4, 6, 9-13, 15-18, 21 and 22 are obvious (35 U.S.C. 
§103) over Endo (U.S. Pat. No. 7,228,275) in view of Watanabe (U.S. Pat. 
No. 4,641,342). 

Whether claim 5 is unpatentable over Endo in view of Watanabe and 
further in view of Kemble (U.S. Pat. No. 7,072,837). 
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VII. ARGUMENT 

A. Obviousness rejection of claims 1-4, 6, 9-13, 15-18, 21 
and 22 over Endo in view of Watanabe 

Independent claim 1 requires, among other things, 

wherein the first speech recognition engine permits a plurality of 
ports to be used on behalf of a plurality of users and the system 
further comprises a port monitor coupled to the first speech 
recognition engine and to the evaluation logic, wherein the port 
monitor determines a number of currently available ports and, based 
on the number of currently available ports exceeding a threshold, 
causes the first speech recognition engine to be selected and used. 

The Examiner concedes that Endo fails to disclose these limitations, and instead 
turned to Watanabe. Appellants respectfully disagree with the Examiner's use of 
Watanabe in several respects. 

Claim 1 requires the first speech recognition engine to be selected based 
on the number of ports that are determined to be available. The Examiner 
concedes that Endo lacks this limitation. Watanabe also lacks this limitation. 
While at any point in time, there may be a number of input user channels in 
Watanabe that are available, Watanabe does not at all teach determining what 
that the number is, and certainly does not teach using that number as a selection 
criteria for selecting a voice recognizer. 

The Examiner alleges that Watanabe's teaching of recognizing n separate 
voices simultaneously "implies selecting and using the first speech recognition 
engine based on the number of currently available ports exceeding a threshold, 
since more than one voice recognizers are used by the system." Final Office 
Action p. 3. Appellants respectfully submit that the Examiner's conclusion does 
not logically follow from the recited teaching of Watanabe; that is, just because 
Watanabe simultaneously can service multiple users does not imply the selection 
of a recognizer based on the number of currently available ports. To the extent 
that Watanabe even teaches multiple speech recognizers (Fig. 3 of Watanabe 
shows a single recognizer with multiple inputs), Watanabe has no teaching of a 
recognizer being chosen based on the number of available ports. 
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Further, claim 1 requires the port monitor to determine if the number of 
available ports exceeds a threshold in order to determine whether to select the 
first speech recognition engine. Appellants do not find any teaching in Watanabe 
of such a threshold. 

Additionally, the Examiner alleges that Watanabe discloses multiple voice 
recognizers. Watanabe, however, shows only a single voice recognizer 
(recognizer 15 in Fig. 3) with multiple inputs. Claim 1 requires multiple speech 
recognition engines. 

For at least these reasons, the Examiner erred in rejecting claim 1 and its 
dependent claims over the cited art. 

The same or similar reasons apply to the other independent claims and 
associated dependent claims as well. 

B. Obviousness rejection of claim 5 over Endo in view of 
Watanabe and Kemble 

Dependent claim 5 is rejected as allegedly obvious over Endo in view of 

Watanabe and further in view of Kemble. Appellants respectfully note that 

because claim 5 includes all of the limitations of independent claim 1 and 

because Kemble fails to overcome the deficiencies of Endo and Johnson 

discussed above, the Examiner erred in rejecting dependent claim 5 for at least 

the same reason as for claim 1 . 

C. Conclusion 

For the reasons stated above, Appellants respectfully submit that the 
Examiner erred in rejecting all pending claims. It is believed that no extensions 
of time or fees are required, beyond those that may otherwise be provided for in 
documents accompanying this paper. However, in the event that additional 
extensions of time are necessary to allow consideration of this paper, such 
extensions are hereby petitioned under 37 C.F.R. § 1.136(a), and any fees 
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required (including fees for net addition of claims) are hereby authorized to be 
charged to Hewlett-Packard Development Company's Deposit Account No. 08- 
2025. 

Respectfully submitted, 
/Jonathan M. Harris/ 



Jonathan M. Harris 
PTO Reg. No. 44,144 
CONLEY ROSE, P.C. 
(713) 238-8000 (Phone) 
(713) 238-8008 (Fax) 
ATTORNEY FOR APPELLANTS 

HEWLETT-PACKARD COMPANY 

Intellectual Property Administration 

Legal Dept., M/S 35 

P.O. Box 272400 

Fort Collins, CO 80527-2400 
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VIM. CLAIMS APPENDIX 

1 . (Previously presented) A system, comprising: 
a first speech recognition engine; 

a second speech recognition engine; and 

evaluation logic coupled to the first and second speech recognition 
engines, the evaluation logic evaluates the first and second speech recognition 
engines based on evaluation signals from a user and, based in part on the 
evaluation, selects one of said speech recognition engines to process additional 
speech signals from the user; 

wherein the first speech recognition engine permits a plurality of ports to 
be used on behalf of a plurality of users and the system further comprises a port 
monitor coupled to the first speech recognition engine and to the evaluation logic, 
wherein the port monitor determines a number of currently available ports and, 
based on the number of currently available ports exceeding a threshold, causes 
the first speech recognition engine to be selected and used. 

2. (Previously presented) The system of claim 1 further comprising a switch 
coupled to the first and second speech recognition engines and the evaluation 
logic, wherein, based on the evaluation, the evaluation logic causes the switch to 
release a connection to the speech recognition engine that was not selected. 

3. (Original) The system of claim 1 further comprising a communications 
mechanism and, based on the evaluation, the evaluation logic selects the 
communications mechanism that is not the first or second speech recognition 
engines. 

4. (Previously presented) The system of claim 1 wherein if the number of 
currently available ports does not exceed the threshold, the evaluation logic 
compares outputs from the first and second speech recognition engines and 
selects the second speech recognition engine if the outputs are identical. 
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5. (Previously presented) The system of claim 1 wherein if the number of 
currently available ports does not exceed the threshold, the evaluation logic 
determines a response time for each of the first and second speech recognition 
engines and selects the second speech recognition engine if the response time of 
the second speech recognition engine is equal to or shorter than the response 
time of the first speech recognition engine. 

6. (Previously presented) The system of claim 1 wherein if the number of 
currently available ports does not exceed the threshold, the evaluation logic 
receives a first confidence score from the first speech recognition engine and a 
second confidence score from the second speech recognition engine and selects 
the second speech recognition engine if the confidence score of the second 
speech recognition engine is equal to or higher than a threshold. 

7. -8. (Cancelled). 

9. (Previously presented) A system, comprising: 
first means for recognizing speech; 

second means for recognizing speech; 

means for evaluating a parameter associated with the first and second 
means for recognizing speech based on evaluation voice input from 
a user during a session and, based on the evaluation, for selecting 
one of said first and second means for recognizing speech; and 

means for monitoring a number of available ports associated with the first 
means for recognizing speech and for selecting the first means for 
recognizing speech if the number of available ports exceeds a 
threshold. 

10. (Original) The system of claim 9 further comprising means for releasing 
the first or second means for recognizing speech that is not selected. 
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11. (Original) The system of claim 9 wherein the means for evaluating a 
parameter comprises means for assessing the relative accuracy of the first and 
second means for recognizing speech. 

12. (Original) The system of claim 9 wherein the means for evaluating a 
parameter comprises means for assessing the relative performance of the first 
and second means for recognizing speech. 

13. (Original) The system of claim 9 wherein the first and second means for 
recognizing speech comprise a means for determining a confidence score 
associated with the voice input. 

14. (Cancelled). 

15. (Previously presented) A method, comprising: 

evaluating an evaluation set of utterances from a user during a session; 
based on evaluating the evaluation set of utterances, selecting between a 

first speech recognition engine and a second speech recognition 

engine for the remainder of the session; and 
automatically selecting the first speech recognition engine if a number of 

available ports associated with the first speech recognition engine 

exceeds a predetermined value. 

16. (Previously presented) The method of claim 15 wherein evaluating the 
evaluation set of utterances comprises determining a relative accuracy of the first 
and second speech recognition engines if the number of available ports 
associated with the first speech recognition engine falls below a predetermined 
value. 

17. (Previously presented) The method of claim 15 wherein evaluating the 
evaluation set of utterances comprises determining a relative performance of the 
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first and second speech recognition engines if the number of available ports 
associated with the first speech recognition engine falls below a predetermined 
value. 

18. (Previously presented) The method of claim 15 wherein evaluating the 
evaluation set of utterances comprises comparing a first confidence score 
generated by the first speech recognition engine with a second confidence score 
generated by the second speech recognition engine if the number of available 
ports associated with the first speech recognition engine falls below a 
predetermined value. 

19. -20. (Cancelled). 

21. (Previously presented) A storage medium containing code that can be 
loaded into a computer and executed by a processor in the computer, the code 
causing the computer to: 

evaluate an evaluation set of utterances from a user; 

based on the evaluation of the evaluation set of utterances, select between 

a first speech recognition engine and a second speech recognition 

engine; and 

determine a number of available ports associated with the first speech 
recognition engine and to automatically select the first speech 
recognition engine if the number of available ports is above a 
threshold. 

22. (Previously presented) The storage medium of claim 21 wherein the code 
causes the processor to evaluate the evaluation set of utterances, if the number 
of available ports is below the threshold, by performing an action selected from 
the group consisting of comparing a relative accuracy of the first and second 
speech recognition engines, comparing the a relative performance of the first and 
second speech recognition engines, and comparing a confidence score 
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generated by the first and second speech recognition engines, and a combination 
thereof. 

23.-24. (Cancelled). 
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IX. EVIDENCE APPENDIX 

None. 
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X. RELATED PROCEEDINGS APPENDIX 

None. 
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